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ABSTRACT ' 

' One hundred students enrolled in the velding and 

air*ccnditioning/ref rigeration classes at Delgado Community College 
(Louisiana) Irere randomly selected to participate in a study to 
evaluate their effective reading comprehension levels to investigate 
the impact of a study skill "preview" method such as the SQ3R on 
their test-taking abilities^ and to,testxthe readability level of 
their textbooks. Fifty students (25 in each subject area) were tested 
by the regular cloze method pf testing readability. The cloze test K 
consists of selecting a passei^ge of prose material of approximately 
275 words from the students* textbook anH deleting every fifth word.*^ 
gtudenAs are instructed to fill in the blanks with words appropriate 
to the context. The remaining 50 students were given the cloze test 
after exposure to a SQ3R "preview" of the material* Since there was 
little difference between the raw scores of the control and 
experimental groups in either subject area^ it was determined that 
the SQ3R "preview" was of no value in augmenting test-staking skills* 
Since students were able to fill in correctly fewer than 38 percent 
of the blanks r it was determined that the welding and 
air-conditioning/refrigerati©n textbo^oks in current use were probably 
beyond the'^eadability level of the s'tudents. (DC)' 
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Abstract 



As junior /community college educators are confrOitited 
with large numbers of "high risk" students, some method 6f 

bridging 'th6 gap between the student's reading comprehensioiv 

' \ . . , * /\ 

level and the readabi/lity level of textbooks Used must be/ 

/ '/ 

found. This study investigates the effective com preheat io^iT- 
level of welding and air-cpnditi6£ing/ref rigerat ion gtud^ts 
randomlj^ selected from ^ intercity community colli^ge In 
terms ojf textbooks used- in th|f/^oLnssrooms ; investigates the 
readabi/lJ^ty level of the textbooks used in thQ classroom"^ 
where these students were enrolled by the uae of the Fry 
Readal|ility Formtlla; and investigates the influence of an 

I'pr^iew" technique on the test taking ability of th^se 
students. A cloze j^rocedure test was constructed from the 
classroom textbpok and administered to a control and an 
experimental group. An ahalysis of variance was computed 
using a Veldman (1967) F ratio p^oc^dure. The conclusions 
dr^\yn from the analysis of data were that the textbook being 
uset3 jLn the welding classroom was of marginal vaTue and the 
textbook used in the ^ir-conditioning/ref r igerat ion class-, 
rooiij was of little use. Both textbooks would bd difficult 
f or th0 students to comprehend. 



. THE CLOZE. PROCEDURE: A MEASURE FOR DETERMINING 
READABILITY LEVEL FOR VOCATIOUAL JUNIOR COLLEGE STUDENTS 




IntrodiUctr 
^ « *t 

In the past f^w years, the comrihinity/junioi; college^ 
has been undergoing a tremendous expansion. Both accom- 
panying and contributing to this growth, According to 
Calitrl (1970), is the "opesii door policy", that allows many 
students to enter that are disabled readers and may not be 



able to successfully read j^aterials presented in -regular 
college textbooks. This policy of non-restrictive admis-*. 
slon forces the collhege to search for meaningful instruc- 
tional materials jto use with these "high r isk"s,students . 
Instructors recognize that educational materials are of 
little value if they are. written in a language, that is com- 
plex. and obscure to the student and materlfals mx;ist be fotind 
that- will meet the academic antf vocational needs, of the 
.students. 

In a study by Evans and Dubois (1972V, the instruc- 
tor i8 challenged to determine three things about eacfh of 
his students if he is to facilitate instructional learning: 
(1) the reading level of the student, (2) the readability 
level oT the textbook, and (3) the skillis Reeded by the 
student to successfully compete in the classroom. Jualor/ 
community college educators need to determine if a study 
technique cafi be used to successfully change reading 
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res\aM to 



•^mprtphensloii scores\ar^ to determine if Gi6llege textbooks 
can be matched to the needs of students./ 



Purpose 



The purpose of this study was to determine three 



objectives: (1) to evaluate the effective comprehension 
level of the vocational college gitudent with low academic 
potential due to lack of previous experience and low pro- 
ficiency in academic skills aiid abilities in terms of 
selected books; (2) to investigate whether a study skill 
"preview" method such as tlie SQ3R wouW influence the test- 
taking abilities of these/^ stut^ents; and (3) to test the 
readability level of thd ti^xtbooks used ^in the clp^«srooms 
where these students s/udy. If the textbooJks used in the 
claasrooriis where thes4 students are enrolled are too diffi- 
cult, then some provision should be made f'9r these students 
if they are to sucoessfully profit from college instruction 



Subjects 



The subjects for this study were randomly selected 



y 



from the vc^atijbnal/technical school of Delgado Community 

College in New Orleans, Louisiana. Two independent samples 

/ ^ 
were used: C'he group of subjects was from the welding 

class, and ti^e second group was from the ain^condit ioning/ 

ref r igeratlibn class. Subjects constieted of approximately 

50 male students from each class; they ranged in age from 

IB years ^f a^p^ to 25 years of age. The open entry/open 

exit policy pf the school may have caused some subjects to 



be more advanced in the program than others. 

• . ' 

^'^^ Procedures 

— — " — ■ ■ o, 

\ 

^ Each group <yt subjects was administered a cloze 
procedure tes^ from the textbook of the class from which - 
they were chosen. This clo^e test consisted of a passage 
of prose material of approximately 275 words copied from 
4he welding and/or the air-conditioning/refrigeration 
textbook. In each passage every fifth word was deleted and^ 
replaced with an underlined blank sp^jice of standard length. 
After the test was distributed to each subject in thie group, 
the cloze test was explained to the students. For "this 

^' V 

purpose, a transpareiacy was projected on a screen, and the 
blank spaces were fillediin with words solicited frbm the 
students; 

Each group of subjects was randomly divided into 
two subgroups. One subgroup from each independent sample 
(the welding students arid the air-cond it ionii^/ref r igerat ion 
students) , was administered a traditional clo^ prbcedure 
test from the textboolc^ used in ihe class from which they 
wore chosen. The test was passed out to the^group, and 
they were instructed to complete the test by filling in the 
blank spaces with the word they thought had been left out. 
Subjects had not read the material previously. Responses 
wore scored correct when responses exactly matched the 
deleted word. Minor misspelling was disregarded. There 
was no time limit on the test. ^ 



The experimental^ administration of the e^loze test 
was beguil when subgroup two from each independient sample ^ 
was given a textbook used in the classroom from which they 
had been chosen* Subjects ;were directed to turn to a chap- 
ter in the book the pei^^son adnrinister ing the test. ^ 

modified SQ3R survey of the material was made with the sub- 

I 

jects; this- consisted of looking at the title df the pas- 
s^ge, looking at ajly illustrations on the pages, looking at 
the topic headings in bold print, suggesting questions ^ha^t; 
came to mind when going over the topic headings, asking 
subjects to recite what had been gone over in the preview, 
and answering any questions asked by the subjects. This 
took between 10 and 15 minutes. The books were taken up, 
and the subjects in subgroup^ two were administered the sume 
Cloze procedure test that had been administered to subgroup 
one. All testing was done at different times on the same 
day and scored iri the same manner. ^ 

Analysis of Data 
For an analysis of the data, the te^t battery^ was 
scored b^ the researcher a'ccord^pg to the exact deletion r 
criteria as proposed by TayloT^ (1957). The raw scores were 

r 

then transformed into percentages of correct responses. An 
analysis of variance between the mean scores of the raw 
scores and the percentage scores was calculated to determine 
^the variance between the two control groups which were given 
the SQ3R ••preview" before Administration of the cloze test 



/ 
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in each Independent- sample^ Data were computed at the 

University of Southern Mississipipi Computer Center using 

a Veldman (1967) F ratio procedure. 

The following rea^4w*ch hypothesis was tested to 

evaluate the objectives of the study. 

There will be a sjLgnificant difference in the cloze 
responses of the students randomly selected to 
receive the modified SQ3R survey of the matep*^ 
prior to taking the cloze test and the responses of 
the iStuderits that ' are administered the cloze test 
without t>bis ^.lj3i^evie^ Two separate investigations 
wejre conducted in two simi lar 'samples : vocational 
welding and vocational air-condit ioning/ref rigerar 
tion. 0 ^ 

Hypothesis Testing (Welding Subjects) 
The welding subj^ects were randomly seie6ted anc^ 
divided into two subgroups. The control group was' adminis-v 
tered the cloze procedure test constructed fronj^r passages 
from their textbook used in the weldijig class. The expori- 
nlental group was administered the same cloze procedure tost; 



however, before taking the test, the researcher/went 'through 
a. SQ3R "preview" of the material from which the test was 
taken, • ' / ^ 

The hypothesis that there would a significant 
difference in the cloze responses of the welding students 
randomly selected to receive the modified SQ3R survey of 
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the material prior to taking the clc^ze test iand^ the 
responses of the welding students that were adminlstei'ed 

V ^ ' m * 

the cloze test without this "preview," was tested by coin- 
puting an F ratio between tlie mein raw scores of the* i; wo 
subgroups /t^xose* receiving the traditional' closSe ^test an'fl 
those receiving the experimental treatment before tl^cloze 

test). The first analysis used a raw score me,an comparison. 

X 

The F ratio (.332, df 1, 19, £>.05) was not sig- 
nif icant at the established probability level ; therefore , 
the hypothesis was rejected. (See Table 1). There did not' . 
appear to be a difference in the way the. welding students 
responded tt). the two types of clozr^ testing" on the same 
material. . - . " ^ 

Tabje 1 . . 

Analysis qf Variance:" Weldfing Subjects \ 
(Raw Scores) ^ 



✓ 




Wurce 


MS 


df 


^ ratio 


'2 




Group 


I. Control 


18.4 


a, 19 


.332 , 


.577^^ c 




Group 


II. Experi- 
mental 


16.27 


1, 19 


.332 


. .5777 



For a ra^ore observable and practical description of 
tile ca^oze test performance, the cloze scores were changed 
to percentage! scores . The F ratio, of course, remained 
nott-s|.gnif leant . This transfer to pc/rcentage scoreg 
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allowed for a coiiiparison with known cloze success estimates 
Using dloze crii^erion value of 35%' through 40% correct 
(Rankin, . 1969) ,^"it was determined that the we Iding ^roup " 
percentage scoi^es in the control and experimental group ^ 
ind^ate'd: that ' the textboolc* wasu of marginal iit^ility to the 
students since the* percentage scores we^e close to the 38% 
score or the 'jLustiruct i6nal level (See Table 2), . 

- " Table 2 . 

Welding. Sub^^ects (Raw and Percentage Scores 

'\' Cprrect on Cloze Tests) ' ; 





Source * 

• 


■-ftr-T 

Raw ^ 


Percentage 




Group 


I. Cpntrol ^ 


f ' • 9^ 

■ * 

) 18.4 ' 


36.8'^ - 




Group 


II. Experi- 

raeptal - * 


16,7 


32.5 
















Hypothesis 


Testing (Air- 


-Conditioning/ 





^The air-co'ifdit ioning/ref rigeration subjectis were • • 
randomly selected and divided itito two. subgroups . The 
control,' group was administered the cloze procedure test 
constructed from passages from the tej^book used in the 
air-conditionxjag/rof r igerat ion class. The experimental 
group was administered the same' cloze procedure test; how- 
ever, before taking the test, the researcher went through a 



SQ3R '^preview'' of the material from which the test was 
taken. . . ^ 




The hypothesis that there would be a signff leant 
differende in the cloze responses of the air-conditioning/ 

' refrigeration subjects selected to^ receive the SQ3R survey' 

( ^ ' 

<* 

of the material prior to taking the cloze test and the 
^ ' , responses of the welding students that were administered 
the cloze test without this "preview, '! was tested by^ com- 
puting an F ratio betweeftjthe mean'^aw scoa-es'^ of {he tivo 
subgroups (thog^ receiving the traditional cloze test and 
those receiving t)ie" experimental treatment before the cloze 
% test). The F ratio (1.161, df 1, 42, j3>.05) was not sig- 

nificant r^at the established probability level; therefpre, 
the hypothesis was rejected. There was no difference in 
the way the air-conditioning/refrigeration subjeiets 
^ responded to the two types of cldze testing (See Table 3). 

Table 3 

Analysis of Variance: Air-conditioning/ 
Ref r igeVation Subjects (Raw Scorjes) 



1- 





Source 


r 

MS 


df 


F ratio 


2 


• ( 


Group 


I. Control 


8.8 


1, .42 


1.161 


.2874 


) 


iSroup 


II. Experi- 
mental 


10.54 


1, 42 


1. 161 


,2874 





For ^more observable and uteeful description of the 
cloze tes^ performance* the raw scores were ^'.hanged to ^r- 
centage scores. The F ratio^ of course, remained non- 
significant . 
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This transfer to percentage allowed for a comparison 
with known'cloze success, est imates. Using cloze criterion 
value of 35% through 40% correct (Rankin, 1969), it was 
determined that the students could not rqad the textbook, 
with scores /Such a§ 17% and 21%, which were the mean scores 
of the two groups, tfte scores are obswvably lower than a 
needed 35% for instructional level. This difference 
between the students'* ability and the difficulty of the 
material would make the entire testing procedure of this 
researoh in the air-conditioning/refrigeration group of 
little value in a comparison of tradit ional vs. experi- 
mental methods of cloze (See Table 4)'. 

Table 4 . 

Air-conditioning/Refrigeration Subjects (Raw 
and Percentage Scores porrect on Clo;Se Tests) 



Source 


.Raw^ 

— : f ^ 


' Percentage 


Group I. Control 


8.8 


17.6 


Group II. Experi- 
mental. 


10. 54 

i 

>• , : 


21.08 


./ 






\ Additional Investigations 





The readability level of the two textbooks thUt 

were vised in the consttH^ctHon of the cloze procedure tests 

,^ ' * • ' 

for the two groups of subjects was computed according to 

the Fry Readability Formula (Fry, 1972). The textbook^ for 

the welding students, ^ New Lessons in Arc W elding. Was 
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' • computed to be written on .approximately a tenth-grade. l*evel. 
-yr. - The textbooH. f or the alr-conditlbnlng/xtef rlgeratlon stu- 
• . 4ehts> Modern Refrigeration and Alr-'Condlt ioning > was com- 
puted to be on a fairly high college level. Another t^xt- 
bbok that is ysed in the welding class but not. used to 
^ construct the cloze test, The Oxy- Acetylene Handbook s was 
computed to be Written on ^n eleventh-grade , level. These 
computations would certainly indicate that some provision 
should be made for these students in the community/ junior 
/ ' college if they ^re to experience success. 

. ' . ' Summary ' 

f * , / ^ . " . 

On the basis of , the research data collected, the 
4 * . ' . ' 

' hypothesis stating that" there wou^ld be a significant dif- ^ 
ference in the c'^loze Responses of the students ^randomly 
^ selected to receive thtf modified SQSjl survey of the mate- 
"rial pripr to taking the cloze test and the responses of 
the students that were administered the oloze test without , 
Wis "preview" would^e rejected in both vocational samples. 
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However, when the raw scores were converted to percentage 
scores and the means computed, it ^as determined that the 
textbook in the welding class would be of jnargihal utility 
since the percentage scores' were close to the 38% score of 
the instructional level. The Fry Readability Formula was 
used to determine the difficulty of the textbooks used in 
these vocational/technical classyooms from which students 
were chosen for this research. The books were found to be 

^ v ' 0 

X ' V • 

!> » ' S 

f « 

/ 13 ^ 
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too difficult for the students to be successful in their 
study. , Some method of closing the gap between the student 
and the textbook, should be determined by^the college.' 
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